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Chapter  1 
Introduction 

A  sequence  of  complex  data  can  be  modeled  using  a  sum  of  exponentials 
model.  One  approach  to  this  problem  is  to  assume  this  model  for  the 
data  sequence,  use  forward  or  backward  linear  prediction  along  with  total 
least  squares  to  estimate  the  poles  of  the  model,  and  then  use  a  total  least 
squares  method  to  determine  the  amplitude  associated  with  each  pole.  This 
approach  usually  involves  overestimating  the  order  of  the  model  and  then 
ignoring  the  extraneous  poles  which  result.  In  order  to  better  estimate 
the  true  poles,  Singular  Value  Decomposition  (SVD)  can  be  performed  on 
the  linear  prediction  matrix,  the  number  of  singular  values  needed  for  the 
model  can  be  kept,  the  lest,  of  the  singular  values  being  set  to  zero,  and 
then  a  new  linear  prediction  matrix  is  formed. 

If  forward  prediction  is  used  then  the  extraneous  poles  which  are  es¬ 
timated  will  appear  inside  the  unit  circle  [1].  If  the  data  sequence  is  a 
stable  one  then  the  true  poles  also  appear  inside  the  unit  circle  and  thus 
the  two  can  be  confused.  To  avoid  this  problem  backward  prediction  can  be 
used.  The  extraneous  poles  will  appear  outside  the  unit  circle  and  thus  the 
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true  poles  can  be  identified  as  the  ones  appearing  inside.  But  if  the  data 
is  a  sequence  created  from  poles  both  inside  and  outside  the  unit  circle, 
then  neither  forward  nor  backward  prediction  will  allow  for  such  an  easy 
determination  of  extraneous  poles. 

One  method  for  separating  true  poles  from  extraneous  poles  is  to  use 
both  forward  and  backward  prediction.  The  true  poles  will  appear  in  both 
estimates,  but  the  extraneous  poles  will  lie  inside  the  unit  circle  for  one 
method  and  outside  for  the  other.  This  report  considers  the  use  of  such  a 
method,  and  compares  it  with  the  standard  forward  and  backward  methods. 
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Chapter  2 

Forward  Prediction 


Assume  that  N  data  points  are  generated  from  M  complex  exponentials 

with  white  Gaussian  noise  added. 

M 

y(n)  =  akPk  +  u’(77)  n  =  l,...,N.  (2.1) 

k=l 

Here,  p*.  is  the  k th  pole  and  a ^  is  the  amplitude  associated  with  that  pole. 
The  forward  linear  prediction  equations  can  then  be  set  up  as  follows  [1,2,3]. 

y(N  -  1)  ...  y(N  -  L)  1  bfl  T  y(N) 

:  i  :  =  -  ;  (2-2) 

y{L)  •••  y( 1 )  .  bfL  .  .  y{L  +  l) 

or 


Yfbf  =  -cf 


(2.3) 


where  L  is  the  order  of  prediction,  and  bf  is  the  coefficient  vector  of  the 
polynomial  Bf(z)  given  by 

Bf(z)  =  1  f  bflz  1  +  ...  \-bflz  1  (2.4) 


The  solution  first  involves  forming  (c/  :  }/],  performing  a  Singular  \'alue 
Decomposition  (SVD)  on  it,  truncating  all  but  the  first  M  singular  values. 
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and  then  reforming  to  get  a  better  estimate  [c/  :  Yj j,  since  only  M  modes 
are  kept.  Now  6/  can  be  solved  for  using  the  pseudoinverse  ol  Yf, 


bf  =  -  Y/cf. 


(2.5) 


Now  the  estimated  poles  can  be  determined  from  the  zeros  of  Bj(z), 

Pfi  =  rooti  (Bf(z))  i  =  1,2, . . .  ,  L.  (2.6) 


Once  the  poles  have  been  determined,  the  amplitude  equations  can  be 
formed. 


P)  i 


-1 

PfL 


d/i 

'  y(i)  ' 

.  d/L  . 

.  y(N)  . 

or 


Pfhj  =  dj 

Least  squares  can  now  be  used  to  estimate  the  amplitudes. 

6/  =  {pfp,y  pfdf 


(2.7) 


(2.8) 


(2.9) 


A  remaining  issue  is  how  the  true  poles  are  separated  from  the  M  —  L 
extraneous  poles.  It  is  known  [1]  that  the  extraneous  poles  will  lie  inside 
the  unit  circle.  If  the  true  poles  lie  outside  the  unit  circle,  then  separation 
is  easy.  However,  if  the  true  poles  lie  inside  the  unit  circle,  it  is  sometimes 
difficult  to  separate  them  from  extraneous  poles.  One  method  involves 
choosing  a  radius  threshold,  r(,  and  accepting  any  pole  whose  radius  exceeds 
rt  as  a  true  pole.  Another  method  involves  estimating  the  amplitude  of  all 
L  poles,  and  choosing  the  modes  whose  amplitudes  or  energies  exceed  some 
amplitude  threshold.  A  method  related  to  the  latter  one  is  to  keep  all  L 
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I 

|  poles,  and  see  from  the  spectral  plot  how  the  true  and  extraneous  modes 

are  estimated:  if  extraneous  modes  have  low  amplitude,  this  is  evident 
from  the  spectral  plot..  For  the  purpose  of  comparison,  this  method  is  most 
useful,  as  its  performance  is  not  affected  by  the  choice  of  a  threshold  radius 
or  amplitude;  we  will  use  this  method  in  the  examples  presented. 


Chapter  3 

Backward  Prediction 


The  backward  linear  prediction  equations  can  be  set  up  as  follows. 
y( 2)  ...  y(L  + 1)  ki  '  y{ l) 

:  •  i  =  -  :  (3-1) 

y{N-L  +  1)  ...  y(N)  J  [  6, J  [  y(N  -  L) 

or 

Y„k  =  (3.2) 

where  again  L  is  the  order  of  prediction,  and  bb  is  the  coefficients  to  be 
estimated  of  the  polynomial  for  the  inverses  of  the  poles. 

Bb(z)  —  1  +  bt>iz  1  +  • . .  +  Kl:  l  (3.3) 


The  solution  first  involves  forming  [q,  :  Tfcj,  performing  an  SVD  on  it,  trun¬ 
cating  all  but  the  first  M  singular  values,  and  then  reforming  to  get  a  better 
estimate  |cj,  :  V),] .  Now  bb  can  be  solved  for  using  the  pseudoinverst  of  Vj,, 

k  =  ~Yb+cb  (3.4) 
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Once  the  poles  have  been  determined,  the  amplitudes  can  be  estimated  by 
solving  Equation  2.7. 

In  the  backward  method,  true  poles  can  be  separated  from  extraneous 
poles  in  the  same  manner  as  for  the  forward  method.  In  this  case,  extra¬ 
neous  poles  appear  outside  the  unit  circle.  If  the  data  contains  only  modes 
with  poles  inside  the  unit  circle,  the  radius  threshold  (with  rt  =  1),  where 
poles  inside  of  r,  are  kept  rather  than  discarded,  is  an  effective  method  of 
pole  separation.  However,  if  the  true  poles  lie  outside  the  unit  circle,  pole 
separation  can  be  difficult. 


I 

I 


Chapter  4 


Using  Both  Results 


For  some  data,  such  as  radar  target  data,  true  poles  can  appear  both  inside 
and  outside  the  unit  circle.  In  this  case,  neither  the  forward  method  nor 
the  backward  method  has  a  clear  advantage  from  the  pole  selection  point  of 
view.  However,  both  methods  can  be  used  together  as  a  means  of  separating 
the  poles.  Such  a  method  entails  obtaining  the  forward  and  backward  pole 
estimates  separately,  and  comparing  them.  True  poles  will  be  estimated  at 
(nearly)  the  same  location  for  both  methods,  while  extraneous  poles  will 
be  different,  (they  will  be  inside  the  unit  circle  for  the  forward  method  and 
outside  the  unit  circle  for  the  backward  method). 

For  noisy  data,  the  forward  and  backward  estimates  of  a  given  true  pole 
will  in  general  be  different.  They  are  considered  to  be  a  true  pole  estimate  if 
they  are  within  a  distance  d  of  each  other.  The  distance  d  should  be  chosen 
large  enough  to  account  for  variances  in  the  pole  estimate,  but  small  enough 
to  avoid  accepting  extraneous  poles.  Thus,  d  should  depend  on  the  signal  to 
noise  ratio.  When  the  distance  criterion  is  met,  the  pole  estimate  is  chosen 
to  be  the  average  of  the  forward  and  backward  estimate.  The  corresponding 
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modal  amplitudes  are  then  computed  as 


in  Equation  2.7. 
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Chapter  5 

Simulation  Results 


Twenty  data  points  were  created  from  five  poles  near  the  unit  circle  with 
various  amplitudes.  Their  locations,  amplitudes,  and  impulse  response  ap¬ 
pear  in  Figures  5.1  and  5.2.  The  data  was  then  corrupted  twenty  different 
times  by  zero  mean  complex  Gaussian  noise  with  a  variance  chosen  such 
that  the  SNR  was  4.9  dB.  The  poles  and  respective  amplitudes  were  then 
estimated  using  forward  prediction  with  L  =  10  and  M  =  5.  The  results 
appear  in  Figures  5.3  and  5.4.  Backward  prediction  was  then  used  and  the 
results  appear  in  Figures  5.5  and  5.6.  The  combined  method’s  results  using 
a  distance  of  acceptance  of  d  =  .1  appear  in  Figures  5.7  and  5.8. 

Figures  5.9-5.14  are  results  for  a  SNR  of  9.9  dB  with  everything  else  as 
before,  and  Figures  5.15-5.20  are  for  a  SNR  of  14.9  dB. 
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IMPULSE  RESPONSE 


Figure  5.2:  Actual  Impulse  Response 
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The  results  show  that  this  method  improves  the  discernment  of  the  poles 
in  both  the  z-plane  plot  and  in  the  location  of  the  peaks  in  the  impulse 
responses  and  amplitude  plots  for  high  noise  situations.  The  extraneous 
poles  were  eliminated  very  nicely.  The  cost,  however,  is  the  elimination  of 
several  true  poles.  This  indicates  that  on  a  given  trial  all  the  true  poles 
are  not  estimated.  There  is  a  need  for  several  trials  in  order  to  make  this 
procedure  effective.  There  is  also  the  question  of  what  radius  of  acceptance 
to  use;  a  larger  one  will  reject  fewer  extraneous  poles  and  accept  more 
true  ones,  and  vice  versa.  When  the  SNR  was  improved  to  9.9  dB,  the 
improvement  in  discernment  of  poles  was  smaller,  and  for  14.9  dB  the 
backward  prediction  method  was  just  as  good  as  the  combined  method. 
The  forward  prediction  was  in  all  cases  inferior.  Thus  for  higher  SNR’s 
backward  prediction  is  recommended,  and  for  lower  SNR’s,  when  several 
trials  are  available,  the  use  of  the  combined  method  is  better. 
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Figure  5.3:  Estimated  Poles  and  amplitudes  for  Forward  Prediction,  4.9dB 
SNR 
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Figure  5.4:  Estimated  Impulse  Response  for  Forward  Prediction,  4.9dB 
SNR 
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pole  amplitude 


Figure  5.5:  Estimated  Poles  and  amplitudes  for  Backward  Prediction, 
4.9dB  SNR 
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Figure  5.6:  Estimated  Impulse  Response  for  Backward  Prediction,  4.9dB 
SNR 


angle  in  radians 


Figure  5.7:  Estimated  Poles  and  amplitudes  for  Dual  Prediction,  4.9dB 
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angle  in  radians 


Estimated  Impulse  Response  for  Dual  Prediction.  1.9dB  SNR 


Figure  5.9:  Estimated  Poles  and  amplitudes  for  Forward  Prediction,  9.9dB 
SNR 
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Figure  5.10:  Estimated  Impulse  Response  for  Forward  Prediction,  9.9dB 
SNR 
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Figure  5.11:  Estimated  Poles  and  amplitudes  for  Backward  Prediction, 
9.9dB  SNR 
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angle  in  radians 


Figure  5.12:  Estimated  Impulse  Response  for  Backward  Prediction,  9.9dB 
SNR 
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Figure  5.13:  Estimated  Poles  and  amplitudes  for  Dual  Prediction,  9.9dB 
SNR 
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Figure  5.14:  Estimated  Impulse  Response  for  Dual  Prediction,  9.9dB  SNR 


angle  in  radians 


Figure  5.15:  Estimated  Poles  and  amplitudes  for  Forward  Prediction, 
14.9dB  SNR 
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angle  in  radians 


Figure  5.16:  Estimated  Impulse  Response  for  Forward  Prediction,  14.9dB 
SNR 
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pole  amplitude 


Figure  5.17:  Estimated  Poles  and  amplitudes  for  Backward  Prediction, 
14.9dB  SNR 
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Figure  5.20:  Estimated  Impulse  Response  for  Dual  Prediction,  14.9dB 
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Chapter  6 
Summary 


We  considered  a  combined  forward-backward  method  of  estimating  expo¬ 
nential  signals  in  noise  when  the  exponential  modes  may  be  both  greater 
than  one  and  less  than  one  in  magnitude  (i.e.,  when  the  true  poles  lie  both 
inside  and  outside  the  unit  circle).  We  compared  this  method  with  the 
standard  forward  prediction  and  backward  prediction  methods.  We  found 
that  when  the  signal  to  noise  ratio  was  small,  and  when  a  number  of  in¬ 
dependent  measurements  of  a  data  set  are  available,  the  combined  method 
works  better  than  the  standard  methods.  In  other  cases,  the  combined 
method  gave  about  the  same  results  as  the  backward  prediction  method. 
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